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METHOD AND SYTEM FOR REPRODUCTION 
IN A GENETIC OPTIMIZATION PROCESS 

RELATED APPLICATIONS 
This is a continuation application of U.S. Patent Application No. 10/057,245 
(pending), filed on January 25, 2002. 

FIELD OF THE INVENTION 
10 The present invention relates generally to computerized optimization 

techniques and more specifically to techniques based on a genetic modeL 

BACKGROUND OF THE INVENTION 
Due to the large number of variables involved, some optimization problems 

15 have an exceedingly large solution space. For example, selecting design parameters 
such as size and threshold voltage for each of thousands of instances (i.e., gates) in an 
integrated circuit to minimize power consumption while maintaining acceptable 
timing performance is such a problem. 

One approach to solving complex optimization problems is genetic 

20 optimization, an iterative, computer-implemented technique in which candidate 

solutions are generated using a genetic model. The genetic model typically includes a 
set of Af randomly generated chromosomes, each chromosome comprising a number 
of genes. Since each gene represents a particular state of a parameter to be optimized 
in one part of a system (e.g., the size of one instance in an integrated circuit), each 

25 chromosome represents a possible solution to the global optimization problem. In a 
typical application, the configuration specified by each chromosome is evaluated, and 
a figure of merit or "score" is assigned to each chromosome. For example, in the case 
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of an integrated circuit design, a circuit having the characteristics of each 
chromosome may be simulated to assign a score indicating the desirability of its 
power consumption and timing performance. Once each chromosome has been 
assigned a score, the //chromosomes may be "mated" or "mutated" in various ways 

5 to create other potential solutions or "children," which may, in turn, be evaluated and 
assigned a score. If a child has a higher score than one of the original N 
chromosomes, the chromosome with the lowest score may be discarded. Eventually, 
the candidate solutions generated in this fashion may converge to the global optimum. 
A key aspect of such a genetic algorithm is reproduction, the method by which 

10 new solutions are generated during each "mating season." In one well-known 

approach, pairs of chromosomes or "mating combinations" are formed, and mating 
combinations are randomly selected for possible mating. If the composite score of a 
mating combination is higher than a predetermined threshold, the chromosomes are 
mated. Otherwise, they are not mated. However, this approach can lead to too many 

15 or too few children being produced during each mating season, if the threshold is set 
too high or too low. The consequence in either case is slower convergence. 

It is thus apparent that there is a need in the art for an improved method and 
system for reproduction in a genetic optimization process. 

20 SUMMARY OF THE INVENTION 

A method is provided for reproduction in a computer-implemented 
optimization process based on a genetic model. Both a system and a computer- 
readable storage medium containing program instructions are provided for carrying 
out the method. 
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Other aspects and advantages of the present invention will become apparent 
from the following detailed description, taken in conjunction with the accompanying 
drawings, illustrating by way of example the principles of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figs. 1 A-1C are illustrations showing how instances in an integrated circuit 
may be mapped onto a genetic algorithm in accordance with an illustrative 
embodiment of the invention. 

Fig. 2 is a flowchart of a genetic optimization process in accordance with an 
illustrative embodiment of the invention. 

Fig. 3 is an illustration of a set of mating combinations in accordance with an 
illustrative embodiment of the invention. 

Fig. 4 is a flowchart of a method for selecting a particular mating combination 
in accordance with an illustrative embodiment of the invention. 

Fig. 5 is a flowchart of a mating method in accordance with an illustrative 
embodiment of the invention. 

Fig. 6 is an illustration of the operation of the mating method shown in Fig. 5. 

Fig. 7 is a flowchart of a mutation method in accordance with an illustrative 
embodiment of the invention. 

Fig. 8 is an illustration of the operation of the mutation method shown in Fig. 

7. 

Fig. 9 is a flowchart of a method for combining mating and mutation in 
accordance with an illustrative embodiment of the invention. 

Fig. 10 is an illustration of a system for carrying out the methods of the 
invention in accordance with an illustrative embodiment of the invention. 
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DETAILED DESCRIPTION OF THE INVENTION 
Figs. 1A-1C illustrate how instances in an integrated circuit may be mapped 
onto a genetic algorithm in accordance with an illustrative embodiment of the 
5 invention. Fig. 1 A is a gate-level diagram of a simple integrated circuit 100. In this 
simplified example, integrated circuit 100 comprises four instances 105, each of 
which is an inverter. Each instance 105 is labeled A-C to facilitate further 
description. Fig. IB is a conceptual diagram of a chromosome 110 comprising a size 
gene 115 and a threshold voltage (V t ) gene 120 for each instance 105 for a total of 
10 eight genes. Genes 115 and 120 may be represented conveniently as integers. For 
example, size gene 1 15 may comprise an integer between 0 and 5, inclusive, 
corresponding to predetermined physical sizes of the associated instance 105. 
Likewise, threshold voltage gene 120 may comprise an integer equal to either zero 
(low V t ) or one (high V t ). An example of a particular chromosome conforming to the 
15 foregoing scheme is shown in Fig. 1C. 

Fig. 2 is a flowchart of a genetic optimization process in accordance with an 
illustrative embodiment of the invention. At 205, a set of N unique chromosomes 
may be generated. For example, a random number generator may be used to assign a 
value to each gene 1 1 5 or 1 20 in each of the N chromosomes. The set of N 
20 chromosomes will also be referred to as a "chromosome pool" in this description. In 
practice, the values generated by the random number generator may be 
pseudorandom. The performance of a simulated integrated circuit 100 having the 
design characteristics specified by each of the N chromosomes may be simulated at 
210. In this illustrative embodiment, the power consumption of integrated circuit 100 
25 is to be minimized while maintaining acceptable timing. At 210, a score may be 
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assigned to each chromosome indicating how well it meets the design goals. For 
example, the score may be a number proportional to the total power consumption of 
the integrated circuit 100. At 215, a set of mating combinations, each comprising a 
first and a second chromosome, may be generated from the N chromosomes 

5 comprising the chromosome pool. For example, if all possible mating combinations 
are generated for N= 10, a total of M— 45 mating combinations results. At 220, a 
particular mating combination for subsequent reproduction may be chosen from 
among the M mating combinations. The particular mating combination selected will 
also be called a "set of parents" for the purposes of this description. Parent selections 

10 will be explained more fully in a later portion of this description. A set of parents 
(mating) or a copy of a single parent (mutation) may be used at 225 to generate a 
child chromosome. Mating and mutation methods will be explained more fully in a 
later portion of this detailed description. At 230, if the desired number of children has 
been generated, control may proceed to 235. Otherwise, steps 220 and 225 may be 

15 repeated until the desired number of children has been produced. For example, N 
children may be produced during each mating season (one pass through the loop 
comprising steps 215 through 245). However, more or fewer children may be 
produced during each mating season in other embodiments. At 235, each resulting 
child chromosome may be simulated to determine its corresponding performance 

20 score. One advantageous technique is to send each child chromosome to a different 
dedicated processing node in parallel fashion. The best N chromosomes from among 
the original N and the child chromosomes may be retained for the next mating season 
at 240. If the TV chromosomes have converged to within a predetermined tolerance at 
245, the process may be terminated at 250. Otherwise, control may return to 215, and 

25 a new mating season may begin based upon the updated chromosome pool. 
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Fig. 3 illustrates a set of mating combinations 300 in accordance with an 
illustrative embodiment of the invention. Each mating combination 305 is shown in 
Fig. 3 as an ordered pair of the N chromosomes in the chromosome pool. Each 
mating combination 305 may be assigned an index 310 from 1 to M. A composite 

5 performance score (not shown in Fig. 3) may also be assigned to each mating 

combination 305. One simple way to compute such a composite score is to compute 
the product of the score associated with each individual chromosome comprising the 
mating combination 305. Mating combinations 300 may also be sorted or mapped to 
appropriate indices 3 10 in order of decreasing or increasing composite score. In this 

10 particular illustrative embodiment, mating combinations 300 are sorted from best to 
worst composite score, as indicated in Fig. 3. 

Fig. 4 is a flowchart of a method for selecting a particular mating combination 
or set of parents in accordance with an illustrative embodiment of the invention. 
After 2 1 5, a random number generator may be used at 405 to produce a real number R 

15 distributed uniformly on the open interval (0,1). At 410, R may be raised to a power 
E, where E is a real number greater than unity, and multiplied by M, the number of 
mating combinations. The greatest integer less than or equal to this product may be 
computed, and one may be added to generate an integer index K between 1 and M, 
inclusive. The particular mating combination 305 having an index equal to K may be 

20 selected as a set of parents at 41 5. The index K as computed in Fig. 4 biases the 
selection of sets of parents in favor of those mating combinations 305 having a 
favorable composite score. The exponent E, being greater than unity, drives the 
fraction R closer to zero, resulting in a lower index K than would result from a 
uniformly distributed random index based on R alone. This approach also guarantees 

25 that a child will be generated on each attempt, unlike the prior-art threshold method. 
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The exponent E may also be selected and adjusted by a user to provide precise control 
over the degree of bias. Once a set of parents has been selected, a child chromosome 
may be produced by either mating the first parent with the second parent or by 
mutating a copy of a single parent (225). 

5 Fig. 5 is a flowchart of a mating method in accordance with an illustrative 

embodiment of the invention. Following 220, corresponding genes of the first and 
second parents may be compared at 505 to determine which are alike and which are 
different. Those genes that are the same in both parents may be copied to a child 
chromosome at 510. To assign a value for discrepant genes to the genes of the child 

10 chromosome, the loop beginning at 515 may be performed. At 515, a "virtual coin 
flip" may be conducted using a random number generator. The virtual coin flip may 
be fair or biased, depending on the embodiment. If the first parent wins the toss at 
520, the value of the gene belonging to the first parent is copied to the corresponding 
gene of the child chromosome at 525. Otherwise, the value of the gene belonging to 

15 the second parent is copied to the corresponding gene of the child chromosome at 

530. The virtual coin flip at 515 simulates the characteristic of dominance in genetics, 
and a discrepant gene so assigned to the child chromosome will be referred to in this 
description as a "dominant gene." If all discrepant genes have been resolved, control 
may proceed to 230. Otherwise, control may return to 5 15 for the assignment of 

20 another discrepant gene. 

Fig. 6 illustrates the operation of the mating method shown in Fig. 5. First 
parent ("Parent 1") 605 and second parent ("Parent 2") 610 are mated to produce child 
615. Each corresponding gene having the same value in both parents is copied to 
child 615. Here, the threshold voltage gene 120 of A, the threshold voltage gene 120 

25 of C, and the threshold voltage gene 120 of D are copied to child chromosome 615. 
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The discrepant genes are copied randomly from either the first or the second parent, 
as explained in connection with Fig. 5. Here, size gene 1 15 of A is assigned the value 
of the first parent, size gene 1 15 of B is assigned the value of the first parent, 
threshold voltage gene 120 of B is assigned the value of the second parent, size gene 

5 1 15 of C is assigned the value of the first parent, and size gene 1 15 of D is assigned 
the value of the second parent. 

Fig. 7 is a flowchart of a mutation method in accordance with an exemplary 
embodiment of the invention. After 220, a copy or "clone" of one of the two parents 
may be made at 705. Although either parent may be chosen, the first parent will be 

10 selected arbitrarily for the purposes of this description. At 710, one or more genes 
may be selected in the child chromosome for subsequent mutation. In the particular 
embodiment shown in Fig. 7, one gene is chosen at random. The randomly selected 
gene is altered randomly at 715, comprising the mutation. Control may then proceed 
to 230. In some cases, mutation may produce a child that is closer to the desired 

15 solution than mating. As will be explained later in this description, a combination of 
mating and mutation has been found to be synergistic, especially when combined with 
a biased parent selection technique such as that shown in Fig. 4. 

Fig. 8 illustrates the operation of the mutation method shown in Fig. 7. In Fig. 
8, first parent 605 has been copied or cloned to produce child 615. Subsequently, size 

20 gene 1 15 of C indicated by the dotted bounding box has been randomly altered within 
the allowed range, resulting in a change from "4" to "5." 

Fig. 9 is a flowchart of a method for combining mating and mutation in 
accordance with an exemplary embodiment of the invention. After 220, a biased 
virtual coin flip may be performed at 905 to select between mating and mutation. For 

25 example, the biased virtual coin clip may select mutation for 80 per cent of the 
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children produced and mating for the remaining 20 per cent. If the result at 910 is that 
mating is to be performed, a mating method such as that described in connection with 
Fig. 5 may be executed at 915. Otherwise, a mutation method such as that described 
in connection with Fig. 7 may be performed at 920. Once a child has been produced 
5 by either method, control may proceed to 230. As mentioned above, combining a 
biased parent selecting method such as that shown in Fig. 4 with both mating and 
mutation has been found to produce synergistic results. Such an approach can provide 
significantly more rapid convergence than conventional genetic optimization 
techniques. 

10 Fig. 1 0 illustrates a system for carrying out the methods of the invention, in 

accordance with an illustrative embodiment of the invention. Fig. 10 depicts a 
general purpose computer 1005. The methods of the invention may be programmed 
to execute on such a general purpose computer 1005 or, alternatively, the invention 
may be implemented in a special-purpose (e.g., high-performance) computer, in 

15 custom hardware, or in any combination of hardware and software. Program code 
implementing the invention may also be stored on a computer-readable storage 
medium. Examples of computer-readable storage media include solid-state read-only 
memory, magnetic disks, and optical disks. 

The foregoing description of the present invention has been presented for the 

20 purposes of illustration and description. It is not intended to be exhaustive or to limit 
the invention to the precise form disclosed, and other modifications and variations 
may be possible in light of the above teachings. The embodiments were chosen and 
described in order to best explain the principles of the invention and its practical 
application to thereby enable others skilled in the art to best utilize the invention in 

25 various embodiments and various modifications as are suited to the particular use 
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contemplated. It is intended that the appended claims be construed to include other 
alternative embodiments of the invention except insofar as limited by the prior art. 
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